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1.   INTRODUCTION 

Visual  texture  is  well  known  to  play  a  central  role  in  visual 
perception.   In  the  context  of  automated  image  processing,  there  are 
three  problems  which  have  received  extensive  attention  recently,  viz., 
texture  discrimination,  texture  analysis,  and  texture  synthesis.   In 
the  literature  we  find  many  methods  which  deal  with  the  above  problems. 
Most  of  these  methods,  however,  have  little  or  nothing  in  common  and 
lack  generality. 

It  is  our  intention  to  propose  and  develop  a  method  which  would 
be  sufficiently  versatile  to  deal  with  many  of  the  problems  in  texture: 
viz.,  texture  discrimination/recognition,  texture  analysis,  and  texture 
synthesis. 

Our  proposed  method  is  based  on  the  principles  of  signal  detec- 
tion theory.   By  extending  this  method  and  with  the  application  of 
Interval  Covering  Theory  recently  developed  at  the  University  of  Illinois 
by  Professors  B.  H.  McCormick  and  R.  S.  Michalski,  we  show  how  we 
generate  texture  feature  detectors. 

1.1  Brief  Introduction  of  the  Method 

To  serve  as  an  introduction  to  the  method  of  texture  recog- 
nition, we  will  briefly  describe  how  we  presently  deal  with  this 
problem  and  later  on  show  how  it  can  be  extended  to  cope  with  more 
complex  problems . 

We  often  encounter  a  situation  where  we  are  presented  with  a 
pair  of  families  of  visual  scenes  (digitized  images,  of  course)  which 
differ  in  texture,  say,  those  of  malignant  and  nonmalignant  tumor  cells. 
The  problem  is  to  distinguish  and  appropriately  label  any  member  of 
these  families.   This  is  the  problem  of  texture  recognition. 


For  this  purpose,  we  define  a  template  to  extract  patterns  from  the 
scene  of  analysis,  i.e.  n-tuple  of  gray  levels  centered  around  each  given 
positioning  of  the  template.   The  occurrence  of  any  pattern  can  be  considered 
as  an  "event."  All  possible  patterns  that  can  be  extracted  by  the  template 
defines  the  universe  of  events.   With  the  help  of  samples  from  both  texture 
families,  we  calculate  statistics  of  each  event,  such  as  the  probability  of 
its  occurrence  in  any  given  family,  the  "likelihood  ratio"  which  is  the  ratio 
of  the  probability  of  its  occurrence  in  one  family  to  the  other,  and  so  on. 
Using  criteria  which  we  shall  discuss  in  detail  later  in  this  report,  we 
extract  two  disjoint  sets  of  patterns  (events).   The  patterns  in  the  same  set 
have  the  property  that  their  occurrence  in  one  family  is  more  likely  than 
in  the  other.   The  classification  of  an  "unseen"  sample  (i.e.  not  included 
in  the  initial  training  sample)  is  achieved  on  the  statistics  of  the  occur- 
rences of  patterns  belonging  to  the  above-mentioned  sets  in  the  scene  of 
analysis.   The  thresholds  needed  for  the  classification  are  determined 
with  the  help  of  the  training  samples.  We  have  essentially  contructed  a  filter 

by  defining  one  set  as  the  passband  of  events  and  the  other  as  the  stopband. 

A  scene  of  analysis  is  classified  by  the  statistics  of  the  events  that 

would  fall  in  these  bands. 

1.1.1  Interval  Complexes 

Starting  with  the  aforementioned  disjoint  sets  and  with  the  applica- 
tions of  the  methods  in  "interval  covering  theory,"  a  set  of  "interval  com- 
plexes" are  then  developed.   Reserving  the  explanation  of  terminology  and 
other  details  for  a  later  chapter,  we  shall  add -here  only  that  these  "interval 
complexes"  serve  as  2-D  filters  for  textural  features  which  are  more  likely 
to  appear  in  one  family  than  in  the  other. 

1.1.2  Controlling  Parameters 

It   can  be   seen  that  the   analysis   of  texture   is  performed  by 


using  patterns,  which  are  local  in  nature  and  can  only  "be  as  global  as 
the  size  of  the  template  permits.   There  are  also  other  parameters 
other  than  the  size  and  shape  of  the  template,  resolution  -  the 
choice  of  which  has  a  significant  effect  on  the  success  of  the  method. 
Developing  an  algorithm  for  an  optimal  choice  of  all  these  parameters , 
given  the  scenes  of  analysis,  is  one  of  the  top  priority  items  on  the 
agenda  for  future  work. 

1.1.3  Distinguishability  Index 

A  visual  aid  (graph)  and  an  index  derived  from  it  has  been 
developed  to  determine  how  well  the  two  families  of  textures  can  be 
distinguished  for  a  certain  choice  of  parameters.   The  graph  is  known 
as  the  R.O.C.  (Receiver  Operating  Characteristic)  Curve,  as  used  in 
Signal  Detection  Theory.   The  index  can  vary  from  0.5  for  the  worst  case 
(two  textures  are  not  distinguishable  for  the  present  choice  of  para- 
meters) to  1.0  for  an  ideal  case.   This  index  is  a  very  helpful  guide 
in  the  iterative  choice  of  a  better  set  of  parameters. 

1.1. k     Implementation  of  the  Method 

Most  of  the  operations  in  the  method  suggested  can  be  performed 
in  parallel  and  it  can  be  very  easily  implementable  on  a  computer  like 
Illiac  III  utilizing  its  parallel  processing  capabilities.   In  fact, 
programs  have  been  written  implementing  this  method  in  Fortran  using 
"PAX"  Subroutines  which  simulate  the  Pattern  Articulation  Unit  of 
Illiac  III. 

In  the  sections  that  follow,  we  shall  discuss  some  of  the 
problems  commonly  encountered  in  dealing  with  textures.   We  examine  in 
detail  some  of  the  models  proposed  and  recognition  strategies  suggested 
in  the  literature.   We  then  proceed  to  the  formal  presentation  of  our 
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method  and  demonstrate  some  of  the  earlier  successes  we  have  met  with. 
In  the  final  section  we  examine  the  proposal  for  further  work. 


2.   LITERATURE  SURVEY 

2.1  Visual  Texture 

Everyone  seems  to  understand  what  "texture"  means  as  we  live 
in  a  world  rich  in  textures.   If  viewed  at  an  appropriate  angle,  texture 
can  be  seen  in  almost  every  scene.   Yet  it  is  one  of  those  terms  which 
has  escaped  a  precise  scientific  definition.  As  a  matter  of  fact,  the 
host  of  visual  scenes  indicated  by  the  term  texture  is  so  enormously 
large  and  varied  in  nature,  it  appears  that  it  is  a  very  difficult  task 
to  span  the  varied  concepts  of  textures  by  a  single  definition.   The 
definitions  like  "texture  is  that  property  of  material  which  indicates 
what  it  feels  like  if  touched"  and  adjectives  like  "rough,"  "smooth," 
etc.  deal  with  tactile  textures.   We  are  here  exclusively  interested 
in  visual  textures. 

Pickett  [2.13]  observes  that  for  any  visual  scene  to  be  seen  as 
texture,  there  should  be  "a  large  number  of  elements  (spatial  variations 
in  intensity  and/or  wavelength)"  and  that  "the  elements  and  rules  of  spac- 
ing or  arrangement  may  be  arbitrarily  manipulated  provided  a  characteristic 
repetitiveness  remains."  He  adds,  "provided  there  is  sufficient  detail 
shown  in  a  small  enough  visual  angle,  a  characteristic  texture  emerges 
even  when  the  basic  elements  or  spacings  are  randomly  distributed." 
Thus  the  primary  attributes  of  visual  texture  are  "many  variations"  and 
"repetitive  variations." 

Almost  similar  aspects  are  found  in  other  available  definitions. 
But  even  after  a  suitable  choice  of  a  working  definition,  there  remain 
many  difficulties  inherent  in  the  task  of  texture  extraction  technology. 
Hawkins  [3.7]  in  his  paper  enumerates  these  in  great  detail  and  comes 
to  the  conclusion  that  "texture  classification  may  very  well  be  one 
of  the  more  difficult  tasks  in  the  field  of  image  processing." 
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Visual  texture  is  really  very  sensitive  to  external  conditions 
like  lighting  and  angle  of  view,  etc.   The  same  scene  may  present  a 
very  different  texture  even  for  slight  modification  in  the  external 
conditions.   Pictures  in  Brodatz"s  [3.l]  book  on  "Textures"  can  be  used  to 
endorse  the  above  statement.   To  simplify  the  already  complicated  problem, 
we  assume  that  the  scenes  with  which  we  are  concerned  are  taken  under 
similar  conditions. 

With  these  problems  and  its  prospective  applications  in  important 
fields  like  biomedical  sciences  and  remote  sensing  of  the  environment, 
texture  analysis  stands  as  an  attractive  as  well  as  a  challenging  problem. 

2.2  Models  of  Texture 

Textures  can  be  subdivided  into  at  least  two  categories: 
statistical  textures  and  structural  textures.   Statistical  textures  in 
a  visual  scene  can  be  regarded  as  defined  by  a  set  of  statistics  extracted 
from  a  large  ensemble  of  local  measurements  made  on  the  scene.   We  need 
more  information  than  this  to  define  a  structural  texture;  here  the 
texture  is  considered  to  be  defined  by  subpatterns  which  occur  repeatedly 
within  the  overall  pattern  according  to  well-defined  placement  rules, 
as  for  example,  wallpaper. 

Though  we  find  many  textures  which  can  be  classified  adequately 
under  one  of  these  asymptotic  categories,  there  are  still  many  textures 
for  which  a  strict  classification  may  be  questionable. 

2.2.1  Structural  Textures 

As  its  name  suggests,  the  subpattern /placement  model  [3.15] 
appears  to  be  the  most  appropriate  model  to  deal  with  structural  textures. 
This  model  is  by  far  very  widely  used  model  in  the  available  literature. 
The  "Subpattern"  is  sometimes  referred  to  as  the  "unit  cell."  Usually, 
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but  not  necessarily,   the   subpattern   itself  might   contain  sub-sub  patterns 

and  so  on.      For   simplicity,   only  one   level  of  hierarchy   is   considered 

here. 

As  we  accept  this  model,  the  description  of  texture  is  indeed 
simplified  to  developing  a  language  to  describe  the  unit  cell(s)  and 
spelling  out  the  rules  of  its  placement  over  a  given  region.   Similarly, 
synthetic  generation  can  be  employed  to  develop  the  unit  cell(s) 
and  distribute  it  over  the  given  area  according  to  (appropriate  curvi- 
linear) placement  rules.   The  works  of  Trout  [3.22],  Conroy  [3.H],  and 
Rosenfeld  [3.15]  reflect  a  similar  treatment  of  these  problems.   Trout 
attempts  a  formal  description  of  wallpaper-type  patterns.   The  constraints 
of  the  wallpaper  design  are  liberalized  to  provide  a  formal  description  of 
texture  on  a  "generalized  wallpaper"  design.   He  develops  a  syntax-like 
vehicle  to  describe  primitive  patterns.   In  terms  of  these  patterns  and 
appropriate  syntactic  rules,  the  unit  cell  is  described.   The  wallpaper 
pattern,  and  eventually  more  complex  textural  patterns,  can  be  described 
effectively  in  terms  of  these  unit  cells  and  their  distribution.   The  suc- 
cess of  this  scheme  obviously  depends  on  the  judicial  choice  of  the  unit 
cell,  primitives,  and  appropriate  syntactic  rules.   The  crux  of  the  problem 
lies  in  the  choice  of  the  above  parameters  based  on  the  scene  of  analysis. 
This  deserves  more  attention.   Without  practical  simulation  one  cannot 
decide  how  appropriate  the  descriptive  scheme  is. 

Conroy  [3.h]    introduces  the  notion  of  "signs,"  defining  these  to  be 
any  collection  of  lines,  usually  in  close  spatial  proximity  to  each 
other.   These  are  similar  to  Trout's  "primitives."   Suitably  manipu- 
lating the  composition  of  various  signs  of  different  sizes,  Conroy 
attempts  to  generate  realistic  textures.   His  method  can  be  used  to 
generate  a  unit  cell  and  construct  the  whole  scene  by  properly  distri- 
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buting  the  unit  cell.   His  program  requires  as  an  input  the  choice  of 

"signs"  and  their  sizes,  densities,  and  appropriate  spatial  distributions. 

Rosenfeld  and  Lipkin  also  start  with  the  unit  cell /placement 
rule  model  for  the  synthesis  of  texture.   Various  problems  encountered 
in  this  process  have  been  neatly  explained.   Results  are  encouraging 
only  when  dealing  with  man-made  or  artificial  textures  where  the  extrac- 
tion of  unit  cell  is  not  a  difficult  problem.   When  dealing  with  the 
real  world,  for  the  description  or  generation  of  natural  texture,  the 
extensions  of  the  above  methods  have  not  yielded  satisfactory  results. 

The  reason  for  the  failure  of  these  methods  when  dealing  with 
natural  textures  is  obvious.   The  extraction  of  the  holy  unit  cell(s), 
whose  size  and  shape  is  unknown,  is  a  formidable  task.   (So  is  the  choice 
of  primitives,  "signs,"  placement  rules,  etc.  on  which  the  success  of 
the  schemes  described  are  very  much  dependent. )   This  is  the  present 
impediment  when  dealing  with  the  analysis  of  texture.   Further,  when 
analyzing  a  piece  of  texture,  even  if  one  has  successfully  extracted  a 
unit  cell,  it  is  yet  very  difficult  to  decode  the  "secret"  of  the 
placement  rules — which  demands  a  thorough  analysis  at  the  global  level. 

2.2.2  Statistical  Textures 

Many  investigators  in  this  field  have  developed  methods  which 
are  usually  statistical  in  nature  when  working  with  natural  textures. 
Rosenfeld  et  al  have  attempted  to  discriminate  textures  by  merely 
detecting  the  differences  in  averages  of  local  properties.   They  demon- 
strate their  scheme  by  detecting  textural  edges  using  the  gray  level 
as  the  local  property. 

Muerle  [3.10]  also  uses  statistical  analysis  for  the  discrimination 
of  textures.   He  divides  the  whole  scene  of  analysis  into  many  cells. 
Starting  with  a  single  cell,  he  expands  the  region  by  comparing  the 
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statistical  distributions  of  the  cell  with  its  neighbors  and  adding  the 

new  cells  to  fragments  which  have  similar  distributions. 

There  is  yet  another  approach  for  dealing  with  problems  of 
texture,  suggested  by  Bartels  et  al  [3.2].   In  this  scheme  a  digitized 
textural  scene  is  regarded  as  two-way  time  series.   Methods  have  been 
developed  [5.2]  to  determine  the  "order  of  dependence"  in  a  two-way  time 
series.   That  is  to  say,  the  number  of  neighboring  cells  which  influence 
the  brightness  of  a  given  point  can  be  estimated. 

This  information  and  other  relevant  stochastic  properties 
extracted  from  the  time  series  have  been  successfully  used  for  the  proper 
diagnosis  of  tumor  cells  by  Bartels  [3.2], 
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3.   DESCRIPTION  OF  THE  METHOD 
When  presented  with  a  textural  scene  for  analysis,  we  need  to 
perform  the  following  tasks.   First  we  have  to  discriminate  various 
textural  regions.   This  is  the  task  of  scene  segmentation  using  textural 
information.   Later,  if  needed,  we  may  have  to  identify  each  textural 
region  with  any  one  of  the  classes  of  textures  presented  before.   This 
is  the  task  of  texture  recognition.  The  next  in  line  is  the  more 
difficult  task:   to  analyze  each  homogenous  texture  and  try  to  extract 
significant  textural  features  from  it.   Ideally,  of  course,  we  would  like 
to  extract  minimal  information  needed,  perhaps  to  faithfully  reconstruct 
or  synthesize  the  original  texture.   This  procedure,  when  fully  developed, 
would  constitute  texture  synthesis. 

3.1  Texture  Recognition  as  Statistical  Decision  Problem 

Texture  Recognition  can  be  basically  viewed  as  a  statistical 
decision  problem,  wherein,  like  a  single  trial  of  a  psychophysical 
experiment,  a  cycle  begins  with  the  presentation  of  textural  scenes  and 
ends  with  the  response  of  the  decision  maker.   The  type  of  responses 
expected  of  the  decision  maker  varies  with  the  problem.   For  example, 
in  a  typical  recognition  problem,  given  a  textural  scene  T  ,  a  decision 
is  to  be  made  if  it  belongs  to  T  or  T  .   Here  T  represents  a  family 
of  visual  scenes  consisting  of  a  particular  texture,  or,  one  of  the 
hypotheses.   The  alternate  is  T  which  does  not  contain  that  particular 
texture.   The  anticipated  response  here  would  be  either  "l"  or  "0." 
This  is  the  binary  case  we  just  considered  and  the  decision  problem  can 
be  extended  to  a  case  with  multiple  hypotheses. 

It  must  be  clear  that  we  treated  the  particular  texture  as 
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the  "signal."   Other  textures  or  even  the  variations  in  the  same  textures 
can  be  treated  as  the  noise.   When  viewed  from  this  angle,  texture 
recognition  boils  down  to  the  problem  of  detection  of  signal  in  the 
presence  of  noise  and  readily  becomes  amenable  to  well- developed  methods 
in  signal  detection  theory. 

3.2  Description  of  the  Scheme 

Ideally,  each  texture  is  composed  of  one  single  pattern, 
"the  unit  cell"  and  if  one  is  able  to  extract  it,  the  texture  recognition 
problem  would  be  reduced  to  comparing  unit  cells.   But  as  we  have  already 
discussed,  things  need  not  be  so  simple:   More  than  one  unit  cell  may 
be  present  in  a  given  scene,  the  placement  rules  may  be  difficult  to 
extract,  or  no  unit  cell  may  be  detected. 

We  avoid  these  problems  by  defining  our  own  Universe  of  local 
patterns.  We  try  to  determine  which  of  these  local  patterns  characterize 
any  given  texture.   At  this  point,  we  use  the  elements  of  statistical 

decision  theory.   In  what  follows,  we  define  some  of  the  basic  terms 
needed  for  further  presentation  of  the  method. 

3.2.1  Local  Patterns  (Events) 

We  define  a  template  centered  around  a  point  which  samples  the 
patterns  from  the  scene  of  analysis.   Each  possible  pattern  is  an  n-tuple 
of  gray  levels  of  the  nearest  n  neighbors  of  the  given  point  and  is 
represented  as  the  n-dimensional  vector,  e.g.  e  =  (x  ,  x  ,  ...,  x  )  and 
is  regarded  as  an  "event."  All  possible  local  patterns  define  the 
Universe  of  Events,  E  .   For  example,  if  the  digital  picture  was  quantized 
to  "h"  gray  levels  and  the  sampling  template  has  n-cells,  then  there 
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are  h  elements  in  E  .   Figure  3.1  shows  the  number  of  elements  in  the 
universe  for  the  templates  shown. 

3.2.2  Likelihood  Ratio 

The  "events"  described  just  now  serve  as  the  local  evidence 
for  the  decision  maker  at  the  local  level.   The  "likelihood  ratio"  of 
an  event  is  a  single  number  which  is  an  indicator  of  the  strength  of 
evidence  that  the  occurrence  of  that  particular  event  would  provide 

for  the  presence  of  the  signal.   More  precisely  it  is  the  ratio  of  the 

1  0 

probability  of  the  occurrence  of  the  event  in  T  to  that  in  T  . 

This  is  estimated  from  the  "training  samples"  provided  from  both  the 

families  of  T  and  T  . 

Let  E   and  E  be  the  sets  of  events  obtained  from  scanning  T 

and  T  with  a  given  template,  respectively.   Let 

n  (e  )  =  The  number  of  occurrences  of  event  e   in  T 
J_  k  ic 

n  (e  )  =  The  number  of  occurrences  of  event  e   in  T 
UK  k 

nT  =  The  number  of  events  in  T 

Q  0 

nT  =  The  number  of  events  in  T  . 

P  (e  |T  )    =  The  probability  of  occurrence  of  e  in  T 

i.e.  probability  of  e   conditional  on  T  . 

K. 

=     ni(ek) 


nT1 

P    (e    |T    )    is   defined  similarly. 

Then,  the   "likelihood  ratio"   of  the   event  e      is: 

LR(e.)       -     r!jiS 
k  P(e    |T°) 

where  "y"  is  a  normalization  factor  which  compensates  for  the  intrinsic 
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probabilities. 

The  "a  posterior  probability,"  that  is  the  probability  of  truth 

of  the  hypothesis  at  a  local  level  conditional  on  the  occurrence  of 

the  event,  can  be  shown  to  be: 

LR(e,  ) 


P(T1|ek)  =  A  (ek)  = 


l+LR(e  ) 
k 


3.2.3  Decision  Goals:   Optimal  Decision  Making 

There  are  four  outcomes  in  the  binary  signal  detection  problems, 
two  errors  and  two  correct  decisions.   A  "false  alarm"  is  to  choose  T 
when  it  is  T  and  a  "miss"  is  vice-versa.   A  "hit"  is  a  correct  choice 
of  T  ,  and  the  correct  choice  of  T  is  known  as  "correct  rejection." 
There  may  be  different  values  associated  with  the  correct  decisions 
and  different  costs  associated  with  the  errors. 

There  can  be  many  decision  goals.   One  of  the  goals,  for 
instance,  is  to  maximize  the  expected  value.   The  "expected  value"  is 
the  sum  of  the  four  terms,  each  representing  the  value  or  cost  associated 
with  an  outcome  weighted  by  its  probability.   Other  decision  goals  could 
be  to:   maximize  a  weighted  combination,  maximize  the  percentage  of 

correct  responses,  satisfy  the  Neyman-Pearson  objective,  and  so  on. 
These  are  discussed  in  detail  by  Green  and  Swets  [5.^]  and  they  prove  that 
whatever  is  the  decision  goal,  the  likelihood  ratio  criterion  is  the 
optimal  decision  rule,  that  is  to  choose  T  if  LR(e,  )  >   $,  where  3  is 
a  positive  number.   6  may  vary  for  each  decision  goal. 

With  this  background,  we  are  ready  to  partially  define  local 
categorizer  xp  on  the  basis  of  training  set  of  information: 
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Let  E     =  event   space 


Fle  =    {e|e   eE1  U  E°  and  LR(e)    >    3} 
F°3  =    {e|e   eE1  U  E°   and  LR(e)    <_  3) 
F*  =    {e|e   eE^E1  U  E°} 
Then,   define  ty     by  its   acceptance   set  R,   i.e. 

^„(e)   =  1  iff  e   e  R 

n 

where  F13  C  R  C  F13  U  F* 
and  Rf\F°3  =  0 

Note  that  the  determination  of  which  events  in  F*  are  in  R  has 
not  been  made  at  this  point.   These  represent  the  "don't-care"  events 
and  their  assignment  is  made  later  in  this  report. 


3.2.1+   R.O.C.  Curve 

The  Receiver-operating-characteristic    (ROC)    curve    (Figure   3.2)    is 
a  useful  device  for   observing  and  predicting  the  behavior   of  these   cate- 
gorizers.      To  make  the   curve,   each  event   e   e   E     U  E     is   regarded  as   a  two- 
component  vector  with  x  =  p(e|T    )    and  y  =  p(e|T    ).      An   ordering  can  be 
imposed  on  these  vectors  by   sorting  them  in   descending  order  by  the 
likelihood  ratios   of  the  e's.      The   curve   is   generated  by  placing  the 
tail  of  the   first  vector  at  the   origin   and  then  concatenating  the  rest 
in  order.      The  ROC   displays    several     useful  items   of  information   in   an 
easy-to-see   form.      For  one  thing,   the  training-set  performance  of  a 
categorizer   for  each  value   of  3   is   shown  directly,    since   for  each 

threshold,   the  y-coordinate   is   equal  to  Z  p(e|T    )    and  the 

{e|LR(e)>3> 

x-coordinate  is  equal  to      E     p(e|T  ).    The  point  on  the  ROC 

{e|LR(e)>3> 

corresponding  to  a  given  value   of  3   is   easy  to  find,   since   it   is   the 
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Figure  3.2.  Receiver-Operating— Characteristic  Curve 
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head  of  the  vector  with  slope  =  3.   (Note  that  3  only  has  a  discrete 
number  of  values  with  different  performance  effects.)   The  ROC  also 
provides  a  measure  of  the  inherent  separability  of  the  textures  in  the 
training  set.   The  area  under  the  curve  is  equal  to  .5  if  the  textures 
are  non-distinguishable  (all  events  occur  with  equal  probability  in 
both  textures)  and  is  equal  to  1.0  if  the  textures  are  perfectly 
distinguishable  (all  events  occur  in  one  or  the  other  texture  but  not 
both). 

3.3  Classification  Scheme 

As  indicated  earlier,  there  are  two  levels  in  our  classification 
scheme.   One  of  the  simple  procedures  would  be  to  "mark"  all  the  events 
belonging  to  the  acceptance  set  R  which  occur  in  the  scene  of  analysis. 
Based  on  the  global  characteristics  such  as  the  percentages  of  these 
"marks"  final  decision  regarding  the  state  of  the  world  can  be  made. 
The  thresholds  needed  for  this  global  classification  would  be  estimated 
from  the  learning  samples. 

We  did  not  include  events  from  F*  in  the  acceptance  set.   If 
the  events  in  R  are  not  too  many,  this  simple  method  would  provide 
quick  and  satisfactory  results.   It  becomes  cumbersome  if  there  are 
too  many  events  in  R.   This  case  is  dealt  with  in  the  next  chapter. 

3. h     Coloring  the  Scene  of  Analysis 

It  is  sometimes  convenient  to  have  the  following  transformation 

of  the  scene.   A  point  in  the  transformed  plane  is  marked  "l"  (or  dark) 
if  the  corresponding  point  in  the  scene  of  analysis  has  an  event  in  the 

acceptance  set  R.   Otherwise,  it  is  marked  "0"  (light).   The  resultant 

picture  is  the  "colored"  image  of  the  scene  of  analysis.   An  ideal  case: 
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Colored  images  of  samples  of  T  would  be  all  "dark"  and  those  from  T 
would  be  all  "light."  This  would  be  the  same  as  the  output  of  a  series 
of  filters  with  the  scene  of  analysis  at  the  input.   Generation  of  these 
filters  (interval  Complexes)  from  the  acceptance  set  will  be  described 
in  the  next  chapter. 

3.5  Multiple  Textures 

Thus   far  we  have   considered  only  binary  signal  detection    (T 
and  T    ).      The   scheme   can  be   extended  to  multiple  textures    case   just 
the   same  way   as   the  binary  signal  detection  problem  is   extended  to  that 
of  M-ary   signal  detection.      When  there   are  M  different   classes   of  textures 
present,    (T    ,   T    ,    .  ,.,.T    ),  we  need  to   calculate   at   least  M-l   "likelihood 
ratios"   from  which  other  likelihood  ratios    can  be   calculated. 

Here  LR..    (efc)   =  T   „   p^    |    T .  ) 

The  universe  of  events  will  be  partitioned  into  M-dis joint 

acceptance  sets.   An  event  e  will  be  included  in  the  R  acceptance 

set,  iff, 

ER..(e.  )  >  1  for  all  i  4   j 
ji  k 

This  simple  extension  sometimes  leads  into  many  practical 
difficulties  when  dealing  with  large  M  for  certain  choice  of  parameters. 
This  phase  is  still  under  investigation  and  possible  ways  to  resolve 
some  of  the  difficulties  will  be  mentioned  in  the  last  chapter. 

In  general  for  satisfactory  results,  for  larger  M,  we  need  to 
have  a  larger  universe  of  events,  which  means  more  computation  time. 

3.6  Texture  Discrimination 


We  can  mark  the  various  textural  regions  in  a  composite  scene 
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if  we  are  given  the  samples  of  textures  that  might  be  present  in  it.   The 
procedure  is  the  same  as  before:   extract  disjoint  acceptance  sets  of 

events  representing  each  texture,  "color"  the  composite  scene  with  each 
set  in  a  different  "color"  (gray  level).   Ideally,  we  end  up  with  each 
textural  region  marked  with  a  different  appropriate  color. 

For  extracting  the  "textural  features"  we  need  to  introduce 
the  elements  of  interval  covering  theory  which  is  attempted  in  the 
next  chapter. 


20 

k.      INTERVAL  COVERING  THEORY: 
GENERATION  OF  TEXTURAL  FEATURE  DETECTORS 

We  have  described  a  local  categorizer  in  the  previous  section 
and  in  principle  it  could  "be  implemented  by  just  looking  up  input 
events  in  a  table  of  events  and  likelihood  ratios.   However,  for  real 
textures  and  useful  neighborhood  sizes,  the  number  of  events  in  the 
acceptance  set  R  could  be  too  large  to  make  the  process  practical. 
Also,  no  categorization  would  be  performed  for  events  not  in  the  training 
set.   By  applying  some  concepts  from  switching  theory,  equivalent  but 
much  more  efficient  categorizers  can  be  generated.   This  is  accomplished 
by  a  technique  analogous  to  switching-theoretic  procedures  for  minimi- 
zation of  the  disjunctive  normal  form  of  a  switching  function. 

18 
In  the  case  of  binary  signal  detection,  the  events  from  F 

DR 
can  be  considered  a  "true"  set  and  those  from  F   are  considered  a 

"false"  set.   The  disjunctive  normal  form  can  be  expressed  as  V  £.(e.) 

i   x   -1 

where  5 .  is  a  predicate  that  has  output  "true"  when  the  input  is  a  par- 

"1  ft  Oft 

ticular  event,  e. ,  from  F   ,  and  output  "false"  if  it  is  from  F   .   The 

symbol  V  above  represents  the  logical  "OR"  of  the  predicates.   Events 

from  F*  are  considered  as  don't-care  events.   McCormick  and  Michalski 

have  developed  "interval  covering  theory"  as  a  generalization  of 

switcning  theory  [5.8]  which  permits  the  transplantation  of  much  of  the 

minimization  machinery  already  in  existence.   In  particular,  Michalski' s 

Q  r     i 

A     algorithm   L5.7J    for  generation  of  quasi-minimal  covers   can  be  used. 

k.l     Notation 

To  explain  the  method,  it  is  necessary  to  introduce  a  few 
items  of  notation  from  [5.7]: 

E  is  the  event  space  as  before.   That  is,  the  set  of  all  events 


e  =  (xn ,  xoJ  . . . ,  x  )  where  0  <  x.  <  h  -  1. 
1'   2        n         —  l  — 

a   b 
A  literal,   iv  i,  is  the  set  of  all  events  e  e  E  whose  i-th 

1 

component  lies  between  a.  and  b. : 

aix  i  =  {(x1,  x2 xn)   |   a.  <  x.^b.}. 

i 

An  interval  is  a  set-theoretic  product  of  literals, 


-  n 


L   /  '     \   \  IC{1,  2 n}. 

ie±        i 

The  interval  represents  a  "box"  in  hyperspace  which  includes  all  events 
between  (a  ,  a  ,  ...,  a  )  and  (b  ,  b  ,  ...,  b  ).   Note  that  components 
not  specified  by  the  interval  are  free  to  lake  on  any  integer  value  in 

[0,  h-1]. 

lft  Oft 

An  interval  cover  of  the  set  F   against  F   is  defined  as 

a  union  of  intervals,  L.,  such  that: 

y 

F16C  U  L.  OF13  U  F*. 
—  J 

18 
Thus  an  interval  cover  contains  all  the  events  in  F   plus  some  in  F* , 

OS 
but  none  in  F   .   However,  the  interval  cover  will  represent  this  par- 
titioning of  the  space  of  possible  events  much  more  concisely  than  just 
enumerating  all  the  events  in  the  acceptance  set  for  T  .   Also,  the 
interval  cover  can  classify  events  which  were  not  in  the  training  set, 
because  of  the  inclusion  of  F*  events  in  the  "boxes."  A  quasi-minimal 

Q 

cover  can  be  generated  via  the  A  algorithm,  which  we  can  only  sketch 
here. 

U.2  Generation  of  Interval  Covers 

We  can  make  this  procedure  clear  by  means  of  a  simple  example. 

"I  g  Qg 

For  1-D  textures  shown  in  Figure  U.la,  the  F   and  F   are  shown  in  Table  1. 

For  this  example,  an  interval  cover'  (a  minimal  one,  as  it  turns  out) 

can  be  generated  manually  by  means  of  a  visual  aid,  the  Generalized 

Logic  Diagram  (GLD),  which  was  introduced  by  Michalski  [5.7]  (Figure  k.2). 
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In  the  particular  case  when  variables  assume  only  two  values,  the  GLD 

reduces  to  a  diagram  which  resembles  a  Marquand-Veitch  diagram.   The  GLD 

is  a  representation  of  the  entire  event  space,  E:   64  events  in  this 

18 
case.   To  use  it,  the  events  of  F   are  mapped  in  as  ones  and  those  of 

F  ^  as  zeros.   The  squares  left  over  represent  F*  (don't  cares).   The 
cover  is  found  by  an  iterative  procedure  which  begins  by  picking  the 
first  "one"  encountered  in  a  TV-like  scan  of  the  GLD,  and  discovering 
all  of  the  maximal  intervals  which  include  that  "one,"  but  no  zeros 
(an  interval  "star").   One  of  these,  the  interval  including  the  most 
"ones,"  is  added  to  the  covering  set  (initially  empty).   All  of  the 
ones  included  in  the  "star"  are  temporarily  eliminated,  and  the  scan 
of  the  GLD  is  resumed.   The  first  "one"  encountered  is  selected,  and 
the  iteration  repeats.   Eventually  all  the  "ones"  have  been  eliminated. 
If  all  "ones"  are  included  in  the  covering  set,  then  the  cover  is  mini- 
mal.  Otherwise,  the  cover  is  patched  up  to  include  the  neglected 
events,  and  may  not  be  minimal. 

This  procedure  was  followed  for  the  example ,  and  a  minimal 
covering  using  three  intervals  resulted:   (Figure  4,1b) 

23  3  130223  2323 

1  ~        2  3    '  2   ~        1  2  3'  3  ~        1  2 

If  these  are  used  to  form  a  categorizer  HL. ,  where  ^(e)  =  1  for 

e  £R  =  L  U  L  U  L  ,  then  the  event  categorization  shown  in  Figure  4.1 

results.   The  asterisks  appearing  above  Texture  1  and  Texture  0  indicate 

events  for  which  ^  had  output  =  1.   The  subscripts  on  the  asterisks 
R 

denote  the  interval  producing  the  "hit."  Notice  that  the  probability 
of  a  hit  (19/20  =  .95)  and  the  probability  of  a  false  alarm  (3/20  =  .15) 
is  as  predicted  by  the  ROC  (Figure  4.1c)  for  the  likelihood  ratio  decision 
rule  with  3=1.   These  textures  could  easily  be  discriminated  by 
labeling  regions  with  hit  density  over  some  averaging  aperture  greater 
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than,  say,  55%   as  Texture  1.   In  a  digital  parallel  processor,  like  the 

Illiac  Ill's  Pattern  Articulation  Unit,  f  is  an  image  filter.   The  input 
to  the  filter  is  a  digitized  picture  in  several  gray  values,  and  the 
output  is  a  binary  plane  labeling  each  element  in  the  input  picture  as 
to  which  texture  the  picture  element  most  likely  belongs.   The  appli- 
cation of  simple  smoothing  or  noise-removal  algorithms  would  then  make 
segmentation  into  texture  regions  relatively  easy. 

k.3     Intervals  as  Textural  Feature  Detectors 

Intervals  were  achieved  as  "boxes"  into  which  events  from 
the  acceptance  set  R  were  efficiently  packed.   As  the  events  in  the 
acceptance  set  occur  more  frequently  in  T  than  in  T  ,  the  intervals 
which  are  nothing  but  groups  of  such  events ,  have  a  tendency  to  define 
features  which  are  more  likely  to  be  found  in  T  than  in  T  .   Sometimes 
it  has  been  found  in  a  practical  case  that  some  intervals  pick  up  features 
like  vertical  lines,  horizontal  lines,  herringbone  patterns,  etc.  which  are 
perceived  by  human  beings.   Some  of  the  features  extracted  by  other 
choices  of  intervals  may  be  very  poorly  matched  for  human  perception. 
Strategies  for  the  choice  of  "good"  intervals  remains  to  date  largely 
unexplored. 

These  "intervals"  can  be  treated  as  2-D  filters  which  detect 
textural  features  more  common  to  T  than  T  .   The  normalized  "output 
count"  of  the  filters  (normalized  number  of  input  "local  patterns" 
from  the  scene  of  analysis  that  fall  in  the  "pass  band"  of  the  filter) 
can  be  used  as  a  feature  vector.   In  this  multidimensional  space,  we 
will  be  dealing  with  clusters  of  the  scenes  from  T   and  T  and  for 
classification  purposes  we  can  resort  to  any  popular  cluster  analysis 
methods . 


2k 
It  may  be  noted  that  the  generation  of  "interval  covers"  was 

possible  for  the  binary  case  only.   Extension  of  this  procedure  for  the 

case  of  multiple  textures  is  reserved  for  further  investigation. 
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p(hit) 


0.75 


0.60 


0.45 


0.30 


0.15 


RESPOND  T,  IF  l(e)>:.25 
> RESPOND  "Ti  IF  l(e)>1.3 

RESPOND  "Tj"  IF  l(e)>1.3 


0.15  0.30        0.45        0.60         0.75         0.90    1.00 

p(false  alarms) 


Figure   U.lb.      R.O.C.    for  Textures   Shown  in  Figure   U.la 
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TEMPLATE    DEFINING    EVENTS' 


INTERVAL    COVER 


X«     X2     X3 


K3 


XK 


1     3   0     2    2     3 

X,  x2  x5 


XX 


NOTE:   Lower  limit  for  each  variable  is 

indicated  in  lower  right  hand  corner 
and  the  upper  limit  in  the  upper  left 
hand  corner. 


Figure  4.1c.   Interval  Cover  for  Textures  Shown  in  Figure  U.la 
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5.   APPLICATION  OF  THE  METHOD:   EXAMPLES 
For  the  purpose  of  identification,  each  event  can  be  assigned  a  unique 
positive  number.   It  will  be  convenient  to  refer  to  the  event  by  this  number 
known  as  the  "Gamma"  of  the  event. 

e  =  i  x..  ,  Xp ,  . .  .  ,  x  j 

n-1 
y(e)  =   Z   x    h1 
i=0 
where  h  is  the  no.  of  gray  levels  into  which  the  digital  picture  is  quantized. 

We  introduce  the  following  three  disjoint  sets  which  will  be  very 
frequently  referred  to  in  the  examples : 

F1  =  {eleeE1  and  e^E°}  =  {e|eeE1uE°  and  LR(e)=»} 

F°  =  {ele^E1  and  eeE°}  =  {eleeE^E0  and  LR(e)=0} 

F*  =   {e|ee(E1uE°)\(F1uF0)} 

The  events  in  F *  are  arranged  in  descending  order  according  to  the 
likelihood  ratio. 

5.1  Extraction  of  Textural  Regions 

We  will  first  illustrate  the  method  with  a  very  simple  example. 

T  is  the  checkerboard  pattern,  and  T  is  the  unit  grid  pattern. 
(Fig.  5.1a).   Both  are  binary  textures. 

The  templete  which  extracts  events  is  shown  in  Fig.  5.1b.   Total  number 
of  events  in  the  universe  is  2  =  l6. 

We  scan  the  input  pictures.   Collect  E  and  E  .   We  can  partition  E 
into  the  following  disjoint  sets. 

F1  =  {10,  5>* 

F*  =   {   } 

F°  =  {lk9   13,  11,  7>* 
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CHECKERBOARD     PATTERN 

T1 


Figure  5.1a  Textured  Scenes 


g2     9i 
* 


e={g0.gi.g8.gs} 


Figure  5.1b.  -Template  Defining  the  Event 


1.0 


1.0 


Figure  5.1c.   R.O.C.  for  Textures  Shown  in  Figure  5.1a 
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F*  =  Rest  of  the  10  events 

18  Oft 

As  there  are  no  common  events,  we  have  F   =  {10,  5)  and  F   = 

{lU,  13,  11,  T>  for  all  0.   The  ideal  R.O.C.  curve  is  shown  in  Figure  5.1c 

It  can  be  clearly  seen  that  we  are  able  to  extract  the  "unit  cells" 

from  the  above  scenes  with  the  size  of  the  template  defined;  this  is  the 

secret  behind  the  ideal  separation.   Now  it  is  easy  to  identify  these  regions 

in  a  combined  scene  by  recognizing  the  events.  A  corresponding  point  in  an 

output  plane  is  marked  "l"  or  "0"  depending  on  whether  the  event  extracted 

18      08 
at  a  given  point  in  the  combined  scene  belongs  to  either   r   or  F   respec- 
tively.  Thus  we  obtain  a  "colored"  output  picture  with  each  region  marked 
differently.   We  can  even  use  this  plane  as  a  mask  to  extract  the  desired 
region  from  the  original  scene. 

Generally,  the  separation  will  not  be  ideal,  in  which  case  we  do  not 
expect  that  any  region  will  appear  in  a  single  color.   In  such  cases  we  use 
training  samples  for  both  T  and  T  and  color  them.   Then  we  extract  a  thresh- 
old for  the  area  of  a  given  region  to  be  in  one  color  (or  for  the  ratio  of 
areas  of  different  colors)  which  classifies  the  majority  of  the  training 
samples  correctly.   We  can  color  the  unknown  samples  and  will  classify  them 
by  using  this  threshold. 
Example : 

Samples  of  textures  T  and  T  are  shown  in  the  figs.  5.2a  and  5.2b. 
These  are  binary  pictures,  and  a  3  x  2  sampling  template  is  used.   The  R.O.C. 
is  shown  in  Fig.  5.2c. 

We  used  grids  of  the  same  sizes  as  used  in  T  but  with  different  amounts 
of  noise  added  in  the  first  set  of  test  samples  (Figure  5. 2d)  to  be  recognized  as  a 
some  random  pictures.   A  correct  classification  has  been  made  for  this  set  as 


*  Here  onwards  events  are  identified  by  y's  only.   N-tuple  representation 
will  only  be  shown  when  clarity  is  needed. 
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seen  in  Figure  5.2f.   In  the  second  set  (Figure  5.2e)  we  used  grids  of  larger 
sizes  with  and  without  noise.   Still  the  classification  was  correct  except  in 
the  presence  of  excessive  noise. 

5.1.1  Multiple  Regions 

The  above  procedure  can  be  extended  to  deal  with  multiple  regions. 

The  output  picture  is  expected  to  have  at  least  as  many  gray-levels  (colors) 

as  the  number  of  regions  present  in  a  combined  scene.   Let  tn  ,  t_,  ....  t 

&     jt-  1'   2        m 

be  the  protosamples  of  m  different  textures.  We  can  assign  an  n-digit  binary 
number  to  each  sample,  where  2  >m.  We  shall  start  with  the  least  significant 
bit  (LSB).  All  the  samples  with  "l"  in  the  last  bit  are  grouped  under  T  and 
those  with  "0"  under  T  .  For  this  pair  of  textures  we  obtain  an  output  plane 
in  binary  colors  as  before.  This  one  corresponds  to  the  least  significant 
plane  in  the  output  stack. 

We  can  repeat  this  procedure  for  all  the  bits  at  which  time  the  output 
stack  contains,  for  an  ideal  case,  each  region  marked  in  a  different  gray 
level  (which  is  the  same  as  the  binary  number  assigned  to  that  region). 

The  success  of  this  scheme  for  any  given  m  depends  on  the  nature  of 
the  template  (size  and  shape)  selected.   (Here  we  assume  that  the  number  of 
gray-levels  in  a  scene  and  the  resolution  are  invariant.   The  influence  of 
these  parameters  on  the  said  scheme  is  a  case  for  further  investigation). 
The  template  size  should  be  large  enough  to  accomodate  the  largest  unit  cell 
in  the  given  samples.   Normally  better  results  are  expected  with  larger 
templates,  the  only  drawback  being  the  loss  of  sharpness  of  the  boundary  curves, 

The  basic  limitation  of  this  scheme  is  that  the  operations  on  the 
pictures  can  only  be  as  global  as  the  size  of  the  template  permits^  That  is 
to  say,  for  smaller  templates  the  analysis  is  pretty  much  local  in  nature. 
If,  in  any  case,  analysis  at  a  more  global  level  becomes  necessary,  this 
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Figure   5.2a.      Samples   of  Texture  T 
(Various   Grid  Sizes  with  and  without  Noise) 
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Figure  5. 2d.   First  Set  of  Test  Samples 
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Figure  5.2e.   Second  Set  of  Test  Samples 
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Figure  5.2f.  Results  of  Classification 


ko 

scheme  may  be  conveniently  used  as  a  preprocessor. 
Example 

Fig.  5.3a  is  the  input  picture,  consisting  of  four  different  textures 
t  ,  t  ,  t  ,  and  ti.   (Grids  of  various  sizes.)   Fig.  5.3b  is  the  binary 
"coloured"  picture  {t  ,  t  }  as  T  and  {t  ,  t.}  as  T  .   Fig.  5.3c  is  the  binary 
"coloured"  with  {t  ,  t  }  as  T   and  {t  ,  t>}  as  T  .   The  combined  picture 
(Fig.  5.3d)  shows  each  region  marked  in  different  gray  level. 
Example 

Fig.  5.^   shows  the  brain  cells  with  three  textures,  background,  cyto- 
plasm and  nucleus  marked  differently. 

5.2  Border  Extraction 

When  two  textured  regions  meet,  the  events  picked  up  along  the  border 
can  be  expected  to  be  different  from  those  that  occur  in  the  core  of  either 
regions,  for  the  simple  reason  that  they  are  made  up  from  parts  of  both  the 
regions.   We  may  say  that  the  "border  texture"  is  different  from  the  textures 
on  either  side.   We  can  use  this  fact  to  force  all  the  events  in  the  border 
into  a  set.   Later  when  this  set  is  colored,  the  border  will  appear  distinctly. 

Let  t   and  t_  be  the  protosamples  of  textures  present  in  a  combined 
scene  T  .   Let  us  consider  the  union  of  t   and  t   as  T  .   We 

proceed  as  before     and  obtain  F  ,  F  ,  and  F  .   It  is  intuitively  clear 

0  1    <j> 

that  F  is  a  null  set  because  t   and  tn  are  part  of  T  .   F  contains  all 

events  in  both  T  and  T  .   F   contains  only  the  events  that  occur  in  T 

exclusively,  which  are  nothing  but  the  border  events;  therefore,  when  we  color 

the  F  set  we  obtain  the  location  of  the  border  (Figures  5.5  and  5.6). 
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Figure  j^a^  _  A  Scene  with  Multiple  Texture s  ( t  ,  t  ,  t  ,  t .  ) 
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Figure  5 -3b.   Binary  'Colored'  linage  of  the  Input  Scene 
(Output  of  the  Filter)  with  T  =  j t  ,  t  A   and  T  = j  t  ,  t,  i 
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KHX«XXK8KKXKKXKMKKXv4XN>)NX:<.N>]XXKX, 

_n  x  ;<  x  a  x  a  a_  x  k  34  ;<  x  ;•:  x  x  x  »  a  a  a  mxm.i  «  a  a  a  a  a  «• 

KKX88KNKXKXKXKkXN*XXXXXXI\'i.X.<KXWKB, 
JCKKKKXHBKXKXttXXfcKXtt.4XMKN.<iiX(llt4XaX01. 

XaaXXaaOiaNadX.SiNXXX  laiAXa  <X8a8XKB. 
_BKKXXXKX«KXK.<k.-.*sX.vX.«  1XXXX  XWXXXXXX, 

KaKadaaa*fcX;sXXXXXXXXXXXX  XiXXJXXKH, 
_8_£ ;<x:<AAAiK*l>,U>«.A*v<  :<N XX  <X X X Xi< KS « 

aaaaaxaaBX^OUKXXXXXaaxxxXXfcaXSXa. 

X  KX  XXX  XX  Sk-sKX.".^  ,•,*,<.*  .«XNK0iX«a8XXB, 

BxaxaaaaaxxxxxxxxxxxxxxuMXixxxxxx. 

BaNKXSXKK&XKXXXNXXXXXKX.sXXXHXaaa. 

k«XXaxaaXXX^<iXXO<XJJ  <XXk<XXXXXXXXX8, 
_R  XK  X  XMKK  >K.K  XX XfcvCKXX  A  i  XX<\  XXX  XX .X XS  . 

BXX£Xaaa:<XXXXXXKXX.4X  *aXXXXXXX8  8«. 

BXXXKXKXXKXKXKXX^XXXXXXN^.'.XXXaaa. 

XaXa^aaaXXi^WX^XXXJaXXXXXXXXXXSa. 

K«XKKXXKSRXXXXXXXXXX;«XX!XX.";L\XXaaa. 

HHXl&aaaBa8X3KKfr:.N»K.4aaX8aXtX&XX8KH. 

KaXXXaXXXXXXXXXXXXXXXXXXX.XXaXXaaj 
V»a3Xaxa"sxXK3Ka8««4aaxxa:jXXXXXKB« 

8X^aa«KKXXXXXK*aKKX.i;4XXXXX;,<XXaXM, 

Ba8aaa88KX*8aX.XK8XMaaaXKX-40iaaB8», 

RKKKXXXXXKK  KXXKXKKXX.>$XXXXXXaXXaa. 

axKaaaaaaxxe:xxxxxx:«KaxKXKKXKKX8». 
Kxxx&xK«xxxxxxxxxx.<x<axxxxc<xxa8^ 
IgM&^aaaaaxxKXXxxs&aaaxaaiUMaaaxx'. 
axKSxaxaxKXiiKxxxxxxxxxxxxxxxdaaa. 
BxaaxaaaaxaaaaaKaaaaxaxxxaxaBxaa. 
XKKKKxaxxKXKXS.'.xxxaa^axxxxaxKKaa. 
«aKU«aaKXKXKXx«xxaxaaKxax.xc<«xxx». 

KKKKKKXKXKXKXXKiiXXXXXKXXXXaXXXaa, 


HMxaxaaxKxxexxx&KxxxaxaxKXXXxiXKK.  .MKixxxxaaaaaxa^MNxxaaHtfaNxaaaaa 
.KKXKxsKaaKaKaaixaaxaaaxaxxMMxxxNB •_•»•_ •_•_•••_••  ••_••_•_ 

XNXMaaaXXXXKXXXXXXXa.'KXiXKXaXXXXXX 

KKKXXKKgXXXKXXXXXKXXXXXXXXXXXKK.. » 

aHX^2Xa83XXXXXX»XXXM)!KXXXXC<£XHX 

_K_ XXKXajf 88 X X B8X8M S8 XX  <XXX X.^XXXXXW 

KNBxxaaxaxKsxax'xaxaaaaaaaaxxxKxx. 

M8KX8X8XKKXfcXXXXMXXXXXXXXXKXM«M. 

BxafcMaaaaxaKXX'xxxaaaxxxxacsxxaaxa 

_»KK8SX3  8aX«HXKXtiKXXX  -CKfcXKXXXfcXX..  .  .  .  .  ...  •_•••_•••_•• ?_ 

BXXHMaxaXKXKXXXXaaaX.-lXXXXXaXXXX 

aaaxaaaxxx  x  k  x  k  xk  xaaa  «a  x  x  sxxoSskm 

BsaxaaBBaxxxxaKaxxaaxaxxxaaaaaaa 

j^m«8Mkk«kxkxxx^kxx«xxn;cxx*,xxxxx .......... 

BxxxxaaxMKxaasxKxaaaaixaaxsxaxxKH .>.. 

_B8K8SXXB8KKXXX»XKXXX.$XXCiXXXXX»K. 

BKXXXXaaXMXKX'XXCXXXXX  iXX.vXXXXXXa 

_88KKXX8KKSXg3XC<X«XXXXXXcsi.'..\X>jXXXa * » 

Mxxxaaxxix^xxxxxxxxxx,<xxx.<xc>,xxx8a 

.SaKKKXXKKUXKXXXXXKXXXXXX^XKXXXXrfl. 

KXxgaxaaxxxKXKXKXKXxxxxxxxiXxaxaa 

BXXaXXXSlMXUXXXXXXXXXXXXliXNXXiaM 

8XXKXxyKKxa«xxaxxxaaaxxa«aax«8  8 

B8KKKX3 RRK8  KXKkKSXXXXXXN XXX XXX  KH 

MaKsaaaaxwxKxxxaxxxxxxxxxxxxxaxa 

HKXXSXXKfcXXBKKXKXKXXXXKiCXXXXXXXa.  . ._._.  .  . 

BKaxaxxaKrtX«axxxxxx.i<xxxxx8xxaxa 

HKKKaaXKKKXKXKSSKXXXXXXXXXXX-Xaa 

BXX8aa.<XXX.<iXXXXXXXXX  VXXXXXIXX.XX8 

axxaxa-xxaxxassxxxxxxxxsxxxxxiOKXX 
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Figure  5.3c.   Binary  'Colored'  Image  of  the  Input  Scene 
(Output  of  the  Filter)  with  T1  =  {t^tj  and  T°  =  [t  ,  t.  ] 
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Figure  5.3d.     Combination  of  Figure  5. 3b  and  Figure  5.3c 
(Resulting  in  a  Scene  with  Four  'Colors') 
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Figure  5.k.      Filtered  Images  of  Brain  Nuclei 

(Codes  to  extract  parameters  such 
as  maximum  diameter,  perimeter, 
etc.   have  been  written) 
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Figure  5.5.      Border  Extraction:      Example   1 
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Figure  5-6.     Border  Extraction:      Example  2 
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5.3     Iteration 

1  r  or  in 

After  obtaining  F        and  F     for   a  given  pair  of  textures  T     and  T    , 

if  we  go  back  and  color  the  original  scenes,  we  obtain  T  and  T  .  This  out- 
put pair  is  more   easily  distinguishable  than  the   original  pair.      As   a  matter 

of  fact   for   an   ideal  case,   T     and  T     should  be  uniform  and  in   completely 

c      c 

different  colors.   When  this  is  not  the  case,  as  it  happens  in  general.,  we 
can  repeat  the  whole  process  using  the  colored  pair  as  input  pictures. 

Let  us  define  an  operator  C  which  operates  on  a  pair  of  scenes: 

C 

{T1,!0}  -+  {T1,  T°} 
c   c 

By  repeated  application  of  operator  C, 

n 

{T1,  T°}  2  {T1   ,  T°  } 
'         n     n 
c     c 

we  can  go  on  iterating  until  we  obtain  a  satisfactory  separation  in  the  out- 
put pair  (Fig.  5.7a-b).  The  improvement  in  ROC  curve  towards  the  ideal  case 
with  each  iteration  can  be  seen  in  Figure  5.7f. 

It  is  clear  that  each  point  in  the  output  picture  is  a  function  of 
neighbors  around  a  given  point  in  the  original  picture.  As  a  result  of 
iteration,  the  points  in  the  output  plane  depend  (maybe  weakly)  on  a  larger 
and  larger  area  in  the  original  scene.   That  is  to  say,  we  are  operating  on 
the  original  pictures  at  a  more  and  more  global  level  with  each  iteration. 

The  test  picture  also  will  be  colored  iteratively  using  the  results 
obtained  at  each  iteration  and  can  be  subjected  to  the  filtering  process 
with  the  filters  obtained  at  the  last  iteration  which  has  given  satisfactory 
separation  of  the  applied  pair.   At  this  moment  a  decision  can  be  made  as  to 
which  scene  the  test  scene  belongs. 

5.U  Interval  Complexes 

In  the  following  examples  we  have  extracted  the  interval  complexes 
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Figure   5.7a.      Textures   of  Straw   (T    )    and  Wood  Grain (T    ) 
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Figure   5.7b.      "Colored"   Images   of  the  Input  Pictures 
at  the  End  of  the   5   Iterations 
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Figure  5.7c.   Same  Textures  as  Shown  in  Figure  5.7a 
Scanned  at  Coarser  Resolution 
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Figure  5.7d.   "Colored"  Images  of  Textures  in 
Figure  5.7c  at  the  End  of  3rd  Iteration 
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/  Q 

with  the  help  of  the  program  written  in  PL/1  which  implements  the  A  algo- 

Q 
rithm.   We  obtain  the  quasi-minimal  cover  with  A  algorithm  by  the  disjoint 

star  method. 

Example : 

8  interval  complexes  (2-D  filters)  obtained  with  herringbone  pattern 
as  T  and  a  random  picture  as  T  are  shown  in  Figure  5.8a.   The  multiple 
texture  scene  used  for  analysis  is  shown  in  Figure  5.8b.   It  contains  a 
herringbone  texture  slightly  above  the  lower  righthand  corner.   Figure  5.8e 
shows  the  output  of  the  series  of  all  eight  filters  for  the  scene  of  analysis. 
As  expected,  the  herringbone  texture  is  blocked.   Figures  5.8c  and  5«8d  show 
the  output  of  individual  filters  for  the  same  input  scene  (Figure  5.8b).   It 
can  be  seen  that  features  like  horizontal  lines  and  vertical  lines  have  been 
passed  through — thus  it  is  demonstrated  that  some  of  these  filters  can  be  used 
to  extract /enhance  some  of  the  features  which  the  human  eye  can  perceive. 
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Figure  5.8a.   Interval  Complexes  (2-D  Filters)  for 
T  =  Random  Texture  and  T  =  Herringbone  Pattern 
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Figure  5.8b.   Multiple  Textural  Scene  (input  Scene) 
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Figure  5.8c.   Output  of  One  of  the  Filters  with  Figure  5.8b  as  Input 
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Figure   5.8d.      Output   of  Another  Filter   for  Same  Input 
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Figure  5.8e.   Output  of  All  the  Filters  Placed 
in  Parallel  for  the  Input  Scene  Shown  in  Figure  5.8b 
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6.   FUTURE  WORK 

6.1  Generalized  Linguistic  Model 

In  the  literature  structural  textures  are  treated  differently  from 
those  which  are  mainly  statistical  in  nature.   It  is  our  intention  to  conceive 
and  develop  a  model  adequate  to  cover  both  these  classes  of  textures. 

In  the  proposed  model,  "textures"  will  be  treated  as  "sentences"  gener- 
ated by  a  picture  grammar.   This  grammar  is  characterized  by  a  quadruple 
{V,  V  ,  P,  S}  like  conventional  grammars,  where 

V  =  terminal  symbols 

V  =   alphabet,   V     \J  V     where     V     =  non-terminal  symbols 

P  =  production  rules 

S  =  starting  symbol. 

Here  the  terminal  symbols,   V~  are  pictorial  patterns.   They  may  be 

either  "primitives"  defined  at  this  level  or  complex  subpatterns  developed 
from  primitives  in  a  more  refined  grammar.   The  nonterminal  symbols  can  typi- 
cally consist  of  intermediate  subpatterns,  S 


The  set  of  production  rules  are  different  from  those  in  conventional 
grammars.   Using  these  rules  we  must  be  able  to  generate  a  2-D  scene  from  the 
"basic  patterns,"  using  them  as  "bricks."  The  rules  should  be  capable  of 
allowing  "growth"  of  "sentences"  in  all  possible  directions  (array  grammar). 
Also  the  production  rules  can  be  partly  or  completely  probabilistic. 

We  have  only  briefly  outlined  the  minimal  requirements  of  this  grammar, 
which  should  be  able  to  generate  a  wide  range  of  textures.   It  can  be  easily 
seen  that  the  "subpattern"  can  consist  of  simple  elements  like  a  dot,  a  triangle, 


60 


a  square  etc.,,  or  it  can  have  a  regular  structure  like  a  checkerboard  pattern, 
or  it  can  even  he  made  up  of  a  unit  pictorial  area  with  some  defined  statistical 
properties.  Using  one  or  more  of  such  subpatterns,  a  textural  scene  can  he 
generated  using  either  deterministic  or  probabilistic  rules  of  placement. 

Theoretically  it  appears  a  feasible  model,  acting  as  the  "merger"  of 
different  models  suggested  for  structural  textures  and  statistical  textures 
separately.   We  are  now  studying  the  practical  implications  in  making  it  a 
reality  to  deal  with  textures  occurring  in  nature. 

6.2  Textural  Analysis  Using  Time  Series  Analysis 

It  was  our  initial  intent  to  make  a  just  choice  of  parameters  needed 
for  our  method,  like  size  and  shape  of  the  template,  etc.,  based  on  the  infor- 
mation derived  directly  from  the  scene  of  analysis.  We  resort  to  time  series 
analysis  for  a  suggestion  of  the  appropriate  methodology. 

Any  digitized  visual  scene  can  be  represented  as  a  two-way  time  series. 
The  essential  presence  of  periodicity  hints  at  the  possible  representation  of 
a  digitized  textural  scene  by  Seasonal  Time  Series.  This  choice  seems  quite 
natural  and  very  appropriate  because  there  is  a  striking  correspondence  between 
some  of  the  problems  that  occur  in  textures  and  the  problems  that  are  considered 
in  Seasonal  Time  Series.  For  example:   In  textures  the  repeating  subpattern  is 
not  necessarily  identical  from  place  to  place,  though  it  retains  similar 
characteristics.   These  variations  are  considered  as  the  presence  of  white 
noise,  and  there  are  methods  to  estimate  the  nature  of  this  noise.  As  we  have 
seen,  there  can  be  more  than  one  periodicity  present  in  textures  like  the 
subpattern  consisting  of  sub-subpatterns ,  and  so  on.  This  can  be  treated  as 
the  case  of  Multiple  Seasonality. 
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Let   Z    ,   Z    ,    .  .„,   Z     be  a  one-way  time  series. 

Let   "B"  be  the   "backward  operator"   such  that 

BZt  =  zt-i 

2 
B  Z     =  Z±  and  so   on. 

t  t  -2 

For  non-seasonal  series  it  is  usually  possible  to  obtain  a  parsimonious 

representation  in  the  form 

♦p(B)Tt  =  eq(B)at 

where       $    (B)    is  the  "  aut  or egress ive"  operator,  a  polynomial  in  B  of 
*  order  p. 

6  (B)    is  the  "moving  average"  operator,  a  polynomial  in  B  of 
^      order  q. 

^        A        A 

Z  =  Z  -  Z         Z  =  mean  of  the  series. 

a  is  the  white  noise  process. 
(For  further  details  on  this  ARMA  (aut ore gr ess ive  moving  average)  and  other 
processes,  reference  is  made  to  "Time  Series  Analysis"  by  Box  and  Jenkins.) 
We  extend  this  concept  to  seasonal  models  when  we  obtain 
♦p(B)   *p(BS)   Zt  =  6q(B)  6Q  (BS)  at 

s       s  s 

where  4>p(B  )  and  8n(B  )  are  polynomials  in  B  of  degrees  P  and  Q,  respectively, 
"S"  is  the  length  of  the  season.   This  is  a  multiplicative  model  of  the  order 
(p,q.)  x  (PjQ).   (For  other  variations  of  the  same  model,  refer  again  to  Box 
and  Jenkins. ) 

This  "multiplicative  model"  is  very  useful  in  that  it  can  be  easily 
extended  to  take  care  of  multiple  seasonality.   There  are  methods  available 
to  identify  these  models  and  estimate  the  parameters. 

So  far  we  have  considered  only  one-way  time  series.   One  extension  to 
two-way  time  series  would  be  to  treat  it  as  one-way  series  by  concatenating 
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either  successive  rows  or  columns.   By  doing  this  we  are  imposing  one  more, 
of  course  known,  seasonality.  Another  method  would  be  to  perhaps  generalize 
the  methods  for  a  2-D  case.   Investigations  are  proposed  in  this  direction. 

6.2.1  Interpretation  of  the  Results 

We  can  estimate  the  "order  of  dependence"  from  the  scene  by  time 
series  analysis.  That  is  to  say,  we  can  determine  the  number  of  nearest 
neighbors  that  have  influence  on  the  graylevel  of  a  given  point.  This  result 
will  have  a  strong  influence  on  the  choice  and  shape  of  the  "template".  The 
"length  of  seasons,"  of  course,  gives  the  idea  of  the  size  of  the  repeating 
subpatterns  and  suggests  an  appropriate  choice  of  "unit  cell". 

Once  we  determine  the  template  size  from  the  analysis  of  "graylevel" 
time  series,  we  can  go  one  step  further  to  get  further  results  described  in 
the  next  section. 

6.2.2  "Event"  Series:   Synthesis  of  Texture 

The  "Gamma"  of  an  event  is  described  as  the  unique  positive  number 
which  is  used  for  identification.   It  can  be  looked  upon  as  a  linear  weighted 
combination  of  the  graylevels  of  the  neighbors  of  a  point  extracted  by  the 
template.  We  can  consider  "Gammas"  of  each  event  extracted  at  all  points  as 
the  "event  time  series".  As  we  do  overlapped  scanning  while  extracting  events, 
in  this  time  series  dependence  of  a  value  as  its  previous  value  will  be 
stronger.   The  order  of  dependence,  which  we  anticipate  in  most  cases  to  be 
Markovian,  can  be  estimated. 

From  this  information  we  can  estimate  the  probability  of  any  event's 
occurring  in  a  given  scene.  Subsequently  "likelihood  ratios"  and  so  on  can 
thus  establish  the  link  between  this  model  and  the  previous  method. 

Also  we  can  use  this  information  for  synthesizing  the  textural  scene. 
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We  start  with  an  event  and  the  successive  choices  of  the  "events"  are  made 
based  on  the  above  information.   Each  event  can  be  considered  as  a  "tile" 
in  the  same  shape  as  the  template  and  with  appropriate  graylevels  marked  on 
it.  We  replace  each  event  by  these  "tiles"  and  obtain  the  synthesized 
textural  scene. 

6.3  Optimization  of  Sampling  Strategy 

We  are  in  a  constant  search  for  a  scheme  by  which  we  can  make  an  opti- 
mal choice  of  parameters  that  improves  the  separation  of  a  pair  of  textural 
scenes. 

6.3.1  Quantization  Scheme 

When  we  quantize  all  the  pictures  using  gray  level  ranges  of  equal 
width,  in  many  cases  we  might  be  losing  detailed  information  in  larger 
areas.   One  way  to  avoid  this  is  to  use  "tapered"  quantization  scheme.   Here 
gray  value  ranges  are  adjusted  such  that  in  a  given  experiment  each  gray 
level  interval  occurs  with  equal  probability.   The  quantization  ranges  were 
set  once  by  using  a  composite  gray  value  histogram  derived  from  all  training 
set  samples. 

In  practical  case  we  found  improvement  in  separation  as  indicated  by 
R.O.C.  curve  when  we  use  this  quantization  scheme. 

Investigations  are  being  done  to  discover  such  schemes  for  other 
parameters  like  sampling  resolution  in  the  initial  scan,  scanning  beam 
wavelength,  etc. 

6.k     Multiple  Textures 

We  would  like  to  test  the  hypotheses  that  multiple  textures  will  be 
effectively  discriminated  by  estimating  many  likelihood  ratios,  as  in  the 
case  of  multiple  signal  detection,  by  experimenting  with  real  textures. 
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6.5  Analysis  of  Color  Images 

So  far  we  have  considered  only  black  and  vhite  pictures.  The  spectral 
(color)  information  appears  to  be  very  valuable  in  that  it  is  used  in  many 
classification  schemes  for  photo  interpretation  in  remote  sensing  applications 
and  for  the  interpretation  of  natural  biological  images.  Multi-spectral 
discrimination  has  long  been  an  art  based  on  human  judgment  and  only  recently 
codified  for  remote  sensing  applications.  We  can  extend  these  primitive 
pattern  discrimination  procedures  to  suit  the  format  of  our  method  and  so 
achieve  automated  analysis  of  both  spatially  and  chromatically  textured  scenes. 

Like  many  researchers  who  attempted  this  problem,  we  generate  three 
one-color  images  (red,  blue,  and  green)  from  the  original  color  transparency. 
The  triplet  of  the  gray  level  values  of  a  corresponding  point  in  the  three 
images  (R,  B,  and  G)  can  be  treated  as  an  "event".   Once  we  interpret  the 
"event"  in  this  manner,  we  can  proceed  in  similar  lines  as  before  to  discri- 
minate among  color  images. 

We  can  increase  the  complexity  of  the  "event"  by  considering  the 
"triplets"  of  the  neighboring  points,  which  are  extracted  by  a  template  defined. 
With  this  we  can  perform  colored  texture  analysis. 

Initial  experiments  have  yielded  satisfactory  results,  and  we  intend 
to  pursue  it  further. 

Similar  work  has  been  done  by  Young  et  al,  where  he  makes  use  of  only 
two  quantities  (chromaticities) ,  namely  R/R+B+G  and  G/R+B+G.  The  statistics 
of  these  properties  are  used  for  discrimination. 

The  above  procedure  has  been  suggested  to  demonstrate  the  flexibility 
in  the  interpretation  of  events  and  the  subsequent  analysis.  A  set  of  intervals 
that  can  be  derived  would  specify  the  allowable  band  of  intensities  over  the 
spectrum  of  colors. 
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APPENDIX 

Description  of  the  Programs 

Programs  have  been  written  for  the  analysis  of  texture  using 
signal  detection  theory  techniques  in  FORTRAN  IV.   As  extensive  use  of 
PAX  subroutines  is  made,  familiarity  with  PAX*  is  assumed  in  the  descrip- 
tion of  the  following  programs. 

Two  main  programs  have  been  written.   The  first  one,  TEXROC 
operates  very  efficiently  when  the  number  of  events  in  the  universe, 
E  is  not  too  large  (_^4096).   The  second  program  NUTEX  is  designed  to 
handle  the  case  of  E  >  U096  but  the  expected  number  of  distinct  events 
occurring  in  the  scenes  of  analysis  are  within  the  bounds  (^096).   Nor- 
mally the  programs  run  slowly  and  larger  storage  area  is  needed  if  the 
upper  limit  specified  above  is  increased. 
TEXROC  Program 

This  program  utilizes  efficiently  all  the  parallel  processing 
facilities  of  Illiac  III  (PAX  is  a  simulator  of  PAU  of  Illiac  III).   The 
extraction  of  events  from  a  given  picture  and  the  coloring  routines  are 
all  done  in  parallel.   There  are  eight  entry  points  for  this  subroutine: 

1.  TEXROC  5.   C0L0R1 

2.  PICKEV  6.   C0L0R2 

3.  ORDER  7.   ENDCLR 
k.      ASNCLR  8.   ROC 


*See  "Tne  PAX  II  Picture  Processing  System  At  the  University  of  Illinois 
Programming  Manual,"  Edited  by  R.  T.  Borovec,  Report  No.  3lU,  Department  of 
Computer  Science,  University  of  Illinois,  Urbana,  1969. 
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Subroutine  TEXROC 

Purpose : 

Initialization  routine. 

Usage: 

CALL  TEXR0C(KH,KM,NHM,IDL,N1,KF1,N2,KFM,N3,KF0) 

Parameters: 

KH,  KM         -  Arrays  of  length  NHM  for  recording  the 
number  of  occurrences  of  each  event  in 
the  universe  in  scenes  T  and  T  ,  respec- 
tively. 

NHM  -  Total  number  of  events  in  the  universe. 

IDL  -  Direction  list  defining  the  template. 

KF1,  KFM,  KFO  -  Arrays  in  which  events  belonging  to  F  , 
F  ,  and  F  are  stored  respectively. 

Nl,  N2,  N3     -  Number  of  events  stored  in  KF1,  KFM  and 
KFO  respectively.   This  is  set  up  by  the 
program. 

Execution: 

Both  the  arrays  KH  and  KM  are  cleared  and  other  parameters 
are  passed  on  for  other  entry  points. 
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Entry  PICKEV 

Purpose: 

To  pick  up  events  from  the  given  picture  and  store  it  in 
an  appropriate  array. 

Usage: 

CALL  PICKEV(IPI,NPI,IPC,KHM) 

Parameters : 

IPI  -  Array  of  plane  indices  where  the  picture 

is  stored. 

NPI  -  Number  of  planes  in  stack  IPI. 

IPC  -  Context  plane. 

KHM         -  The  array  where  the  number  of  occurrences 
of  each  event  is  recorded. 

Execution: 

The  stack  of  input  planes  is  shifted  opposite  to  the 
directions  in  the  direction  list  IDL  and  the  resulting  pictures  are 
stacked  in  a  new  output  stack  containing  IDL(l)  *  NPI  planes.   From 
this  new  stack  the  events  can  be  directly  read  at  all  points  indicated 
by  '1'  in  the  context  plane   and  appropriate  locations  in  the  array 
KHM  are  incremented. 

This  subroutine  uses  IDL(l)  *  NPI  scratch  planes.   Due  to 
the  limitations  of  PAX,  IDL(l)  *  NPI  should  not  be  more  than  l6. 

This  subroutine  can  be  called  several  times  to  record  the 
events  from  all  the  various  samples  of  T  and  T   (which  might  be  from 
various  pictures)  in  the  arrays  KH  and  KM  respectively. 
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Entry  ORDER 


Purpose: 


To  partition  the  set  of  events  into  three  sets  F  ,  F  ,  and 
F  and  to  order  the  events  in  F*  according  to  likelihood  ratio. 


Usage: 


CALL  ORDER(KH,KM,NHM,DX,DY,AL,K,Y) 


Parameters: 


KH,  KM,  NHM 
DX,  DY 

AL 


-  Same  as  before. 

-  Arrays  of  length  NHM  for  storing  normalized 
KH  and  KM  arrays. 

-  Array  of  length  NHM  for  storing  X  of  each 
event.   X  =  the  likelihood  ratio/(l  +  likeli- 
hood ratio). 


X,  Y 


-  Arrays  for  storing  coordinates  for  the  ROC. 


Execution: 

Using  the  information  from  the  arrays  KH  and  KM,  the  set  of 
events  is  partitioned  into  three  sets  and  stored  in  the  arrays  KF1,  KFM, 
and  KFO.  Nl,  N2,  and  N3  are  set  to  the  number  of  events  in  each  of  the 
above  arrays  respectively.   The  arrays  should  be  properly  dimensioned 
to  accommodate  the  events. 

The  likelihood  ratio  and  Lamda  is  calculated  for  each  event 
and  the  KFM  array  is  arranged  in  descending  order  according  to  the  like- 
lihood ratio  using  the  SSP  subroutine  RSRT. 

DX,  DY  and  AL  arrays  are  set  as  follows: 

NHM 
DX(I)  =  KM(I)/  I      KM(I) 

1=1 


for  all  I 


NH 
DY(I)  =  KH(I)/  Z  KH(I) 
1=1 


AL(I)  =  LR(I)/1  +  LR(I) 


where  LR(l)  =  DY(l)/DX(l) 
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Entry  ASNCLR 

Purpose: 

To  partition  KFM  set  into  two  sets  using  a  threshold  on 
lamda. 

Usage: 

CALL  ASNCLR(FL,NF1L,KF1L, NFOL, KFOL) 
Parameters : 

FL  -  Threshold  on  lamda 

KF1L,  KFOL   -  Arrays  for  storing  the  partitioned  sets. 

NF1L,  NFOL   -  These  are  set  to  the  number  of  events 
stored  in  KF1L  and  KFOL  respectively. 

Execution: 

The  event  KFM(l)  is  stored  in  KF1L  if  the  corresponding 
lamda  of  the  event,  AL(KFM(l)),  is  greater  than  or  equal  to  FL,  the 
threshold  specified.   Otherwise  it  is  stored  in  KFOL.   NF1L  and 
NFOL  return  the  number  of  events  stored  in  the  above  arrays. 


TO 
Entry  PRINTO 

Purpose: 

To  print  the  arrays. 
Usage: 

CALL  PRINTO ( NF1L ,KF1L ,NFOL ,KFOL , JF1F0 ) 

Parameters : 

KF1L,  KFOL   -  Arrays  containing  the  partitioned  sets  of 
KFM  for  any  given  lamda  ( FL ) . 

NF1L,  NFOL   -  Number  of  elements  in  the  above  arrays. 

JF1F0       -  Fl  and  FO  arrays  are  also  printed  if 

JF1F0  =  1.   If  JF1F0  =0,  it  is  suppressed. 
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Entry  ROC 


Purpose : 


Usage: 


Parameters 


To  draw  the  ROC  curve  on  the  Calcomp  plotter. 


CALL  ROC (X,Y, NT, NF1L, JAXES ) 


X,  Y 


-  Arrays  containing  coordinates  of  the  ROC 
curve . 


NT 


-  Total  number  of  points  in  the  ROC  curve 
(N2  +  2). 


NF1L 
JAXES 


-  Number  of  events  in  KF1L. 

-  X,  Y  axes  are  drawn,  with  appropriate 
marking  and  titles  if  JAXES  =  1,  otherwise 
it  will  be  suppressed. 


Execution 


ROC  curve  is  drawn  for  the  X.and.Y  coordinates  calculated 
before.  Marks  are  made  at  the  end  of  F  ,  F  ^  and  F  n   sets.   Multiple 
curves  can  be  drawn  on  the  same  axes  by  setting  JAXES  =  0  after  the 
first  curve. 

Specify  Calcomp  =  Yes  on  the  ID  card.   The  EXEC  card  should 
be  changed  as  follows : 

//  EXEC  PAX,  GOPGM  =  CALCOMP,  REGION. GO  =  XXXK 
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Entry  C0L0R1,  C0L0R2 ,  ENDCLR 


Purpose: 

To  mark  (color)  the  given  sets  of  events  df   the  input  pic- 
ture by  the  specified  greylevel  in  the  output  picture. 


Usage: 


CALL  C0L0R1 ( IPI ,NPI , IPC , IPO ,NPO ,DX ,DY ,THR ) 
CALL  C0L0R2 ( LEQCL, NEQCL, KCLR) 
CALL  ENDCLR 


Parameters : 


IPI  -  Array  of  indices  of  input  stack. 

NPI  -  Number  of  planes  in  the  output  stack. 

IPC  -  Context  plane. 

IPO  -  Array  of  indices  of  the  output  stack. 

NPO  -  Number  of  planes  in  the  output  stack. 

DX,  DY      -  Arrays  containing  normalized  weights  of 

each  event.  l*as  calculated  in  the  routine  ORDER) 

THR        -  Threshold  on  the  weights  of  events.  An 

event,  I,  is  considered  for  coloring  only 
if  DX(I)  +  DY(I)  >  THR. 

LEQCL       -  An  array  containing  events  of  an  equiva- 
lence class. 

NEQCL       -  Number  of  events  in  LEQCL. 

KCLR       -  The  grey  level  with  which  the  events  in_LEQCL 
appears  in  the  output  stack.  KCLR  < 2 


Execution: 


C0L0R1  is  called  to  initialize  the  coloring  routines.   C0L0R2 
is  called  once  for  each  equivalence  class  and  at  the  end  ENDCLR  is 
called.   This  subroutine  uses  IDL(l)  *  NPI  scratch  planes. 


73 

NUTEX  Program 

This  program  is  a  modified  version  of  TEXROC  to  handle  the 
situation  when  the  number  of  events  in  the  universe  become  too  large. 
It  needs  an  estimate  of  the  upper  limit  on  the  number  of  distinct  events 
that  can  occur  in  a  given  experiment.   In  general  we  will  be  dealing 
with  a  very  small  subset  of  events  from  the  universe.   This  is  not  a 
serious  limitation  in  many  cases.   If  the  upper  limit  is  exceeded  an 
error  message  is  printed.   Most  of  the  entry  points  and  parameters  in 
this  subroutine  have  the  same  description  as  before.   Only  the  differ- 
ences will  be  emphasized. 

The  following  entry  points  have  the  same  description  as 


before: 


CALL  ORDER(KH,KM,NHM,DX,DYsAL,X,Y) 
CALL  ASRCLR ( FL ,NF1L ,KF1L ,NFOL ,KFOL ) 
CALL  PRINTO ( NF1L ,KF1L ,NFOL , KFOL , JF1F0 ) 
CALL  R0C(X,Y,NT,NF1L,JAXES) 
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Subroutine  NUTEX 

Purpose : 

Initialization  routine. 
Usage: 

CALL  NUTEX(lDL,KH,KM,NHM,NMAX,Nl,KFl,N2,KFM,N3,KF0) 
Parameters: 

NMAX         -  Extimated  maximum  number  of  distinct  events. 

other  parameters  have  the  same  meaning  as  before 

COMMON /EVENT /KEVENT(  NMAX) . 

This  program  requires  that  a  common  area  of  length  NMAX  as  shown 
above  be  declared  in  the  main  program. 

Execution: 

As  error  message  is  printed  and  the  program  stops  if  the 
number  of  distinct  events  exceeds  NMAX.  NMAX  <  H096. 
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Entry  .NUPICK 


Purpose: 


To  extract  events  in  a  given  window  from  an  input  picture 
and  store  them  in  the  array  specified. 


Usage: 


Parameters 


CALL  NUPICK(IPI,NPI,IWIN,KHM) 


IPI 
NPI 
IWIN 


-  Array  of  indices  of  input  planes. 

-  Number  of  planes  in  IPI. 

-  The  window  on  the  input  plane  from  which 
the  events  are  extracted. 


KHM 


-  KH  or  KM  array  depending  on  whether  the  scene 
is  T  or  T  . 


Execution: 


Here  the  events  are  extracted  in  a  given  window  in  a  serial 
fashion  unlike  the  routine  PICKEV. 
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Entry  DATAAQ 


Purpose: 


Usage: 


To  file  the  data  for  the  AQ  program. 


CALL  DATAAQ ( THR , KF1E , KFOE , IREV ) 


Parameters: 


THR         -  Threshold  on  the  weight  of  each  event. 

KF1E,  KFOE   -  Arrays  to  store  the  'true'  and  'false'  sets 
of  events. 


IREV 


-  If  IREV  =  1,  another  data  set  is  filed  with 
true  and  false  sets  reversed.   (This  is_the 
same  as  reversing  the  roles  of  T  and  T  for 
AQ.)   If  IREV  =  0,  only  one  data  set  is 
filed. 


Execution: 

An  event,  I,  is  considered  for  filing  if  DX(l)  +  DY(l)  >  THR, 
The  following  information  precedes  the  data: 

QLQT  =  'l'B,  SAVEC  =  'l'B; 
NV,  NL,  Nil,  N00 
KF1E  and  KFOE 
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